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A PERSONAL COMPUTER AND SCANNER FOR GENERATING 
CONVERSATION UTTERANCES TO A REMOTE LISTENER 
IN RESPONSE TO A QUIET SELECTION 

Inventor: 
Lester D. Nelson 

Field of the Invention 

The present invention relates to telecommunications. 

Cross-References to Related Applications 

The following co-pending U.S. patent applications are assigned to the 
assignee of the present application, and their disclosures are incorporated herein by 
reference: 

Ser. No. [ ] [Attorney Docket No. FXPL-01016US0 

MCF/KJD] filed September 8, 2000 by Lester D. Nelson, and originally entitled, 
"A METHOD FOR GENERATING CONVERSATION UTTERANCES TO A 
REMOTE LISTENER IN RESPONSE TO A QUIET SELECTION CALL." 

Ser. No. [ ] [Attorney Docket No. FXPL-01026US0 

MCF/KJD] filed September 8, 2000 by Lester D. Nelson, and originally entitled, 
"A PERSONAL DIGITAL ASSISTANT FOR GENERATESIG CONVERSATION 
UTTERANCES TO A REMOTE LISTENER IN RESPONSE TO A QUIET 
SELECTION." 
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Ser. No. I ] [Attorney Docket No. FXPL-01027US0 

MCF/KJD] filed September 8, 2000 by Lester D. Nelson and Sara Bly, and 
originally entitled, "A TELEPHONE ACCESSORY FOR GENERATING 
CONVERSATION UTTERANCES TO A REMOTE LISTENER IN RESPONSE 
TO A QUIET SELECTION." 

Ser- No. [ ] [Attorney Docket No. FXPL-01028US0 

MCF/KJD] filed September 8, 2000 by Lester D. Nelson, Daniel C. Swinehart, and 
Tomas Sokoler, and originally entitled, "A TELECOMMUNICATIONS 
INFRASTRUCTURE FOR GENERATING CONVERSATION UTTERANCES 
TO A REMOTE LISTENER IN RESPONSE TO A QUIET SELECTION.'' 

Background 

A mobile telephone creates more opportunities for people to talk with each 
other, especially while in public places. 

This expanded ability to converse has some negative aspects brought about 
by talk being an easy-to-use, expressive, and also noisy activity. 

There are several ways that people attempt to deal with the situation of 
having private conversations while in a public place. First, individuals may be 
noisy in their conversation. This approach requires judgment about when privacy 
is not an overriding concern or when talk would be considered acceptable or too 
important to miss in a given situation. 

Second, an individual may talk quietly. It is not uncommon to see a 
telephone user in a comer of the room in an attempt to shield a conversation. This 
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is often inconvenient for the telephone users on both ends and again requires 
judgment to determine when this approach is working adequately. 

Third, the individual may move the conversation elsewhere. It is not 
uncommon to see people leaving the room with a mobile telephone in hand. 
However, the movement itself is distracting, particularly when the telephone user's 
attention is focused on the conversation and not the motion (e.g. banging doors). 
The movement is also often accompanied by snatches of conversation (e.g. "Hello! 
how are you?", "Just a second"). 

Fourth, an individual may use an inaudible technology. Switching the 
conversation to a different modality, such as two-way text pager, is quiet. 
However, all parties to the conversation must be willing and able to switch to new 
modality. 

Fifth, the individual may not take the call. Voicemail is a traditional way of 
dealing with calls when one is engaged. However, some telephone calls must be 
answered. 

Sixth, in addition to the problems of privacy and disruption, recent 
observations of public uses of mobile telephones have revealed other disadvantages 
of mobile communications. Users may need to quickly, but informatively and 
politely, disengage from a conversation when their attention must immediately be 
elsewhere (e.g. listening to an important announcement, negotiating traffic). 

Consequently, there is sometimes a need for the call to either be 
temporarily paused or fully discontinued appropriately by a very simple 
interaction. 
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Therefore, there is a desire to provide a system and method for conducting 
a telephone conversation in a public place without the above-identified 
disadvantages. 

SUMMARY OF INVENTION 

The present invention allows people to converse easily, expressively, and 
quietly while using mobile telecommunication devices in public. 

A personal computer for providing a conversation utterance to a remote 
listener is provided. The personal computer comprises an input for receiving 
audio. A display provides a conversation representation. A memory stores the 
conversation representation and an associated conversation element. The 
conversation element has an internal representation of an audible utterance. 
A processor is coupled to the audio input, display and memory and provides a 
control signal. An audio output provides the audible utterance responsive to the 
control signal and the conversation element. 

According to another embodiment of the present invention, an impedance 
matching circuit is coupled to the audio output. In an alternate embodiment of the 
present invention, a telephone is coupled to the impedance matching circuit. 

According to still another embodiment of the present invention, the 
personal computer further comprises an audio generator coupled to the processor 
and audio output. The audio generator provides the audible utterance. 
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According to yet another embodiment of the present invention, the personal 
computer includes a graphic user interface ("GUI") having the conversation 
representation. 

According to still another embodiment of the present invention, the 
conversation representation is selected from a group consisting of an icon, a 
symbol, a figure, a graph, a checkbox, a GUI widget and a graphic button. In an 
embodiment, the conversation representation is selected from a group consisting of 
a text and a label. 

According to an embodiment of the present invention, the conversation 
element is selected from the group consisting of a phrase, a word, a letter, a 
number, a symbol, or a sound effect. 

According to still another embodiment of the present invention, the internal 
representation is in the format selected from the group consisting of a sound file, a 
record or playback, a text and a MIDI sequence. 

According to an embodiment of the present invention, a user alters the 
conversation representation and/or conversation element. 

According to an embodiment of the present invention, a user deletes the 
conversation representation and/or conversation element. 

According to an embodiment of the present invention, a user adds the 
conversation representation and/or conversation element. 

According to an embodiment of the present invention, a user alters the 
association between the conversation representation and the conversation element. 
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According to still another embodiment of the present invention, a user 
records the conversation element as a digitized audio sequence. 

According to yet another embodiment of the present invention, the 
conversation representation and the conversation element are dov^^nloaded and/or 
uploaded from or to a host computer. 

According to another embodiment of the present invention, the control 
signal is generated in response to a user selecting the conversation representation. 

According to still another embodiment of the present invention, an earpiece 
is coupled to the audio output for listening by a user. 

According to another embodiment of the present invention, a personal 
computer for providing an audible utterance to a remote listener is provided. The 
personal computer comprises an input for receiving audio and a device for 
providing a conversation representation. A memory stores a conversation element 
associated with a conversation representation. The conversation element has an 
internal representation of an audible utterance. A processor is coupled to the audio 
input, the device and the memory. The processor generates a control signal 
response to a device signal. An audio output coupled to the processor and the 
memory provides the utterance responsive to the control signal and the 
conversation element. 

According to an embodiment of the present invention, the conversation 
representation is selected from a group consisting of a button, a switch, a barcode, 
a label, a glyph and Braille. 
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According to still another embodiment of the present invention, a system 
for having a quiet telephone call conversation is provided. This system includes a 
processing device for storing an internal representation of a conversation element. 
A scanning device is coupled to the processing device. A scanning device reads a 
code in association with the conversation element and the processing device 
provides an audible utterance in response to reading the code and the conversation 
element. 

According to an embodiment of the present invention, the code is a barcode 
on a printed card. 

In another embodiment of the present invention, the scanning device is a 
barcode scanner. 

In still another embodiment of the present invention, the scanning device is 
a laser scanner and/or a digital camera. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 illustrates a simpHfied block diagram of a Quiet Call system 
according to an embodiment of the present invention. 

Fig. 2 illustrates a Quiet Call personal computer ("PC") according to an 
embodiment of the present invention. 

Fig. 3 illustrates a simplified block diagram of conducting a conversation 
with Quiet Call system according to an embodiment of the present invention. 

Fig. 4 illustrates a simplified block diagram for preparing Quiet Call 
conversation structures according to an embodiment of the present invention. 
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Fig. 5 is an impedance matching circuit schematic according to an 
embodiment of the present invention. 

Fig. 6 is a Quiet Call flowchart according to an embodiment of the present 
invention. 

Fig. 7 illustrates a Quiet Call graphical user interface ("GUI") according to 
an embodiment of the present invention. 

Fig. 8 illustrates a Quiet Call personal digital assistant ("PDA") according 
to an embodiment of the present invention. 

Fig, 9 illustrates a mobile telephone displaying a Quiet Call GUI according 
to an embodiment of the present invention. 

Figs. 10-11 illustrates a Quiet Call processing device and scanner according 
to an embodiment of the present invention. 

Fig. 12 illustrates a paper having bar codes as conversation representations 
used in a Quiet Call processing device and scanner according to an embodiment of 
the present invention. 

Fig. 13 illustrates a Quiet Call telephone accessory device according to an 
embodiment of the present invention. 

Fig. 14 illustrates a Quiet Call telecommunications infrastructure according 
to an embodiment of the present invention. 

Fig. 1 5 illustrates a Quiet Call state diagram according to an embodiment of 
the present invention. 

Figs. 16a-b illustrates a Quiet Call in-band telecommunication 
infrastructure according to an embodiment of the present invention. 
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Fig. 17 illustrates a Quiet Call out-of-band telecommunication 
infrastructure according to an embodiment of the present invention. 

Figs. 1 8a-e illustrate a VoIP telecommunication infrastructure according to 
an embodiment of the present invention. 

DETAILED DESCRIPTION 

I. Overview 

The method and system described herein (generally known as "Quiet Call" 
or "Quiet Call technology") moves a participant in a public situation to a quiet 
mode of communication (e.g., keyboard, buttons, touchscreen). All the other 
participants are allowed to continue using their audible technology (e.g., the 
telephone) over the normal telecommunications infrastructure. Embodiments of 
the present invention transforms the user's silent input selections into equivalent 
audible signals that may be directly transmitted to the other parties in the 
conversation (e.g., audio signal fed directly into a mobile telephone's microphone 
jack). 

An embodiment of a Quiet Call system is illustrated in Fig. 1 . System 10 
includes a talking area 1 1 with an individual 1 6 and a quiet area or public area 1 5 
with an individual 17. Individual 16 attempts to communicate with individual 17 
over telecommunication infrastructure 12. Specifically, individual 16 uses a 
telephone 18 to dial a telephone 13 of individual 17. Quiet Call technology 14 
allows for individual 17 to have an audible conversation with individual 16 in a 
quiet mode while not disturbing the interaction in quiet area 15. 
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A. Advantages 

The present embodiments of the invention have at least the following 
advantages for both placing and receiving telephone calls. First, the conversation 
is quiet for a user in a quiet area. Non-audible input operations (pressing a key or 
button, touching a display) are translated into appropriate audio conversation 
signals.) 

Second, the conversation is conducted audibly for other users in talking 
areas. Only the participants in public situations need select an alternate 
communication. Other users participate as in any other telephone call. 

Third, the conversation permitted is expressive. Expressive representations 
for different kinds of conversations may be defined (e.g., lists of phrases suitable 
for greetings and answering basic questions - "yes," "no," "maybe," etc). 
Conversation structures may be predefined, recorded as needed, or synthetically 
generated on demand (e.g., text-to-speech). 

Fourth, the communication interface is easy to use when a user is engaged 
in other activities. The interface includes conversation representations so that they 
may be easy to recognize (e.g., icon, text label) and invoke (e.g., point and click). 
One input selection (e.g., button press) may invoke a possibly complex sequence of 
responses supporting the dialogue (e.g., putting a person politely on hold or 
politely terminating the conversation). 

Fifth, the communication interface is situation-appropriate. The interface is 
designed to fit unobtrusively into different public or quiet situations (e.g., a pen 
interface for meetings where note-taking is common). Telephone users often talk 
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on the telephone and use pen/paper simultaneously (e.g., making notes in a day 
planner before hanging up, making use of lounge areas for printed materials and 
laptop during a conversation). The calling interface is designed to work with 
conversations intermixed with note-taking and reference activities. 

Sixth, embodiments of the present invention operate within an existing 
communication infrastructure. An embodiment uses available resources that an 
individual is likely to have (e.g., PC, PDA, data-capable cellular telephone) and/or 
adding low-cost components to assist in the conversation transformations. The 
interface may be implemented on a wide variety of hardware that are 
interchangeable during or between calls and interoperable with each other over an 
existing communications channel (e.g., several participants in a conference call 
may have a different quiet-mode solutions). 

A wide variety of private conversations may be supported in the following 
kinds of public, noisy or quiet situations, including a conference/trade show floor, 
general meetings (e.g., plenary sessions, keynotes), *in line' situations (e.g., 
ticketing, registration, baggage claim), informational meetings (e.g., sales pitch, 
technical overview), large transit (e.g., bus, train, plane), lobby/waiting area, 
meetings where note-taking is required (e.g. technical session, product description), 
parking lot, personal transit (e.g., taxi, car pool, shuttle), restaurant, store (e.g., 
doorway, changing room, aisles), street, and the theater. 

B. Communication Scenarios 

A wide variety of communication scenarios are supported, including but not 
limited to the following. First, one can have general conversation, including 
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simple question and answer, arranging for call back, and receiving information 
while in public. 

Second, it is possible to hold topic-specific conversations, including 
questions and answers on selected, pre-defined topics such as agendas, status, and 
placing and receiving orders or instructions. 

Third, it is possible to utilize call deferral (e.g., Fll-call-you-back or 
Just-a-second buttons). 

Fourth, a Quiet Call embodiment can function as a mobile telephone 
answering machine (i.e., playback of greeting and listen to a recorded message 
from the caller). 

Fifth, Quiet Call embodiments can screen calls (i.e., playback of greeting 
and listen to the caller before deciding to engage in the conversation). 

Sixth, a Quiet Call embodiment acts as a represented presence, in which 
one party acts as an intermediary for people listening in remotely to an event or 
meeting. The represented presence is where a Quiet Call is in progress, but a Quiet 
Call user leaves a telephone's microphone on (not the usual mode for Quiet Calls) 
so the other caller can hear. That way the Quiet Call user can thus interact with the 
caller quietly, and in a sense could represent that person's interest (e.g., at a 
meeting) or could quietly get that person's opinions about the ongoing situation. 

Seventh, Quiet Call is an activity reporter, where a button communicates 
via a quiet-mode interaction (e.g., click the 'Meeting' button on the Quiet Call 
interface and the telephone responds with "Hi, I'm.. .in a meeting... now. It should 
be over in about... 15 minutes..."). 
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C. A Quiet Call Conversation Example 

Ed, a manager in a large engineering firm, is participating in a day-long 
quarterly review of the company's ongoing projects. He and a number of his peers 
have flown in to participate in a sequence of presentations and question/answer 
sessions. 

At the same time, Ed's project is at an important decision point requiring 
comparative analysis of several different approaches. Sue, the technical lead on 
the project, is 'working the numbers' with the other project members. As the 
technical discussions proceed, Sue will require several different conversations with 
Ed to keep him informed of the progress and get his approval when needed. She 
knows that she can reach Ed through a Quiet Call system. 

The first time Sue calls through, Ed has set his telephone for silent alert. Ed 
is about to raise a question, so he quickly defers the conversation with a single 
click that vocalizes to Sue "I can't talk right now, I'll call back ASAP." A Quiet 
Call system allows Ed and Sue to quickly defer a call without either spending 
unnecessary time in a voicemail system. 

When Ed is available at the next change of speaker, he calls Sue and lets 
her know by silently issuing an audible command over the phone that he is still in 
quiet-mode. He does not want to step out of the room for the call because that 
would take too much time. Ed uses his earpiece to hear Sue convey her 
information. Ed signals his understanding and hangs up. When Ed makes the 
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presentation on his own project, he has the most current technical information 
available. A Quiet Call system allows Ed to get information in an unobtrusive 
manner. 

Later, the next time Sue calls, she requires a go/no-go decision from Ed. 
She gives her recommendation and Ed signals his approval. Ed then types in quick 
note that he will be free at 1:30 p.m. for a full debriefing. A Quiet Call 
text-to-speech ftinction voices the message and they both hang up. A Quiet Call 
system allows Ed and Sue to exchange information easily and quickly. 

Sue does not get a chance to call until 2:15 p.m.. When she reaches Ed, he 
signals that he will be with her in a moment, because he was recently briefed on the 
project currently being presented. Ed detaches his telephone from the Quiet Call 
system by simply unplugging it, and quietly steps out of the meeting to talk on his 
mobile telephone as normal. A Quiet Call system allows Ed to switch conversation 
modes as needed while keeping the conversation flow going. 

Late in the meeting, a new project is being introduced and Ed realizes that 
he and Sue have been working on some issues related to the decisions a project is 
making. Ed quickly telephones Sue and enables the microphone on his Quiet Call 
system so that Sue can listen in. Sue tells Ed that this new information is only 
relevant to them if the other project has a prototype built. Ed asks about the status 
of the development at the next opportunity. A Quiet Call system allows Ed to 
share information in an unobtrusive and interactive manner. 

As Ed is waiting in the airport at 5:30 p.m. for his shuttle home, he checks 
in with Sue. He doesn't want the crowded lobby to know his business, so he plugs 
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in a Quiet Call system and reviews the day's events with Sue. As they are talking, 
an announcement on the loudspeaker begins concerning flight delays. Ed quickly 
pauses the conversation, letting Sue know with one button push that he has been 
interrupted. A Quiet Call system allows Ed to converse privately and to attend to 
the events in his surroundings when necessary. 

IL A Quiet Call System 

A Quiet Call conversation as described here is an electronically assisted 
discussion (e.g., a telephone call) being held between two or more parties that has 
the following attributes: 

The conversation is being expressed at least in part vocally (e.g., via 
telephone, cellular telephone, Internet telephone, videophone, two-way radio, 
intercom, etc.). 

One or more parties in the conversation is located in a situation where 
talking is inappropriate, unwanted, or undesirable for whatever reason (e.g., 
meeting, theater, waiting area, etc.). 

Consequently, one or more parties in the discussion uses an alternative, 
quiet mode of discussion (e.g., keyboard, buttons, touchscreen, etc.) to produce the 
audible content of the discussion that is transformed into an equivalent electronic 
representation that may be silently transmitted to the other parties in the 
conversation. 

The term Quiet Call technology is used here to signify the communication 
mechanism, including hardware and/or software, that allows people to converse 
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easily, expressively, and quietly while out in the world. A quiet-mode conversation 
or quiet call is a conversation conducted using this technology. 

In an embodiment of the present invention, two Quiet Call modes of 
operation are defined: 1) Conducting a Quiet Call and 2) Preparing for a Quiet 
Call. 

A. Conducting a Quiet Call 

Fig. 3 is a simplified block diagram of the components structure in a 
Quiet Call system embodiment used for conducting a quiet call. In this mode, a 
user conducts a mobile telephone conversation while at the same time causing no 
audible content produced directly by the local user to the local area because the 
local user is not audibly speaking. Example uses of the Quiet Call system in this 
mode include silent communications while in a meeting and holding private 
conversations in public environments. 

A user views a conversation representation as illustrated by block 35 in Fig. 
3, and makes selections about utterances which are to be voiced over the telephone. 
In an embodiment, conversation representation 3 1 may be icons having text labels 
as illustrated in Fig. 7. A Conversation Element 33a associated with conversation 
representation 31 is stored in an utterance data store 33, that when selected are 
retrieved and submitted to an audio generator 34 to produce the output signals 
needed for the telephone connection. An audio-to-phone connector 35 provides 
this electrical connection. A telephone-to-user connector 30 allows the user to hear 
both the conversation generated by the system and other users. In an embodiment, 
a telephone-to-user connector is an earpiece. A switchable (switch 37) audio input 
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36 allows a user to voice directly into a telephone when appropriate. A stored data 
extractor 32 converts data stored in other formats (e.g., PC calendar entries, 
address books) into a format suitable for audio generation. 

The following describes components in a Quiet Call system embodiment, 
i. Quiet Call System Components 

a. Conversation Representation 
A conversation representation 31 of a conversational element 33a 
(i.e., phrases, words, letters, numbers, symbols, sound effects, and sequences 
and/or a combination thereof) that a user may invoke for initiating conversation 
utterances is displayed to a user. An example of a conversation representation GUI 
is illustrated in Fig. 7. 

A conversation representation 3 1 may take any form that does not require a 
user to vocalize a selection of a conversation element 33 a, including graphical 
(e.g., icons, symbols, figures, graphs, checkboxes, buttons, other GUI widgets, and 
sequences and/or a combination thereof), textual (e.g., displayed text, labeled input 
forms, and sequences and/or combinations of the above), and physical (e.g., 
buttons, switches, knobs, labels, barcodes, glyphs, braille or other tangible 
representation, electronic tags, and sequences and/or a combination thereof). 

A user interacts silently with each conversation representation 31 by 
inspecting it according to its kind (e.g., visually or tactually) and invoking it 
according to its kind (type, point and click, press, eye tracking, scanning, etc.). 

A conversation representation 31 may be presented using one or more 
display surfaces (e.g., computer display, touchscreen, paper, physical device, etc.) 
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or display forms (e.g., pages, frames, screens, etc.). When multiple surfaces or 
forms are used these may be organized in different ways according to user needs 
(sequentially, hierarchically, graph-based, unordered, etc.). A user selects between 
different surfaces or forms according to its kind (e.g., GUI selection, physical 
manipulation such as flipping or turning, button press, etc.). 

A user may update a conversation element 33a and an associated 
conversation representation 3 1 in a visible display as follows. First, an individual 
can add a new conversational element and/or an associated conversation 
representation. 

Second, an individual can delete a conversational element and/or an 
associated conversation representations. 

Third, an individual can change the kinds of conversation representations of 
conversational elements (e.g., text, label, icon). 

Fourth, an individual can change a conversation representation of a 
conversational element according to its kind (e.g., text values, label values, icon 
images). 

Fifth, an individual can change a conversational element associated with 
one or more conversation representations. 

Sixth, an individual can add, delete, or modify the association of a 
conversational element and its conversation representation. 

Seventh, an individual can invoke upload/download for conversational 
elements, their display conversation representations, and associated internal 
representation. 
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Eighth, an individual can invoke record and playback capabilities for 
selected conversational elements. 

b. Utterance Data Store 

Each conversational element (i.e., phrases, words, letters, numbers, 
symbols, sound effects, and sequences and/or combinations of the above) has one 
or more internal representations suitable for creation of audible utterances that may 
be communicated over a telephone line. Conversational element 33a stored in 
utterance data store 33 includes, for example, sound file formats, record and 
playback formats, text, MIDI sequences, etc. These internal representations may 
be stored in and retrieved from utterance data store 33. In an embodiment, 
utterance data store 33 is readable and writeable computer memory as known in the 
art. Retrieval may be accessed randomly, sequentially, by query, or through other 
such known methods. Data for retrieved conversation elements are passed to an 
audio generator 34. 

c. Audio Generator 

An audio generator 34 transforms the internal representations of 
conversational elements into audible formats suitable for transmission over a 
telephone connection. In an embodiment, audio generator 34 is a text-to-speech 
generator, sound card, sound effects generator, playback device, in combination 
and/or an equivalent. 

d. Audio Input 

Direct audio connection (e.g., microphone) at the locale of the user 
may be optionally invoked by a switching 37 (e.g., pushbutton or other physical 
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switch, software switch (e.g., GUI widget), acoustic muffling (e.g., soundproof 
housing or other insulation), and direct electrical connection (e.g., plug). 

Audio recording into an utterance data store may be made by selecting one 
or more elements from the conversational representation and invoking a record 
command. 

e. Audio Output 

Audio output 41 allows for audio generation from an utterance data 
store 33 by selecting one or more elements from a conversational representation 3 1 
and invoking a playback command, 

f. Audio-to-Phone Connector 

A connection is provided between user conversational inputs generated 
from the switchable audio input 36 or audio generator 34 that delivers signals 
appropriate for telephone transmission while causing no audible content produced 
directly by the local user to the local area. This includes direct electrical 
connection of signals, electronically processed signals such as an impedance 
matching circuit, optical to electrical conversion such as infrared detection, 
muffled acoustic signals using a soundproof housing or other insulation. 

Fig. 5 illustrates an impedance matching circuit 22. Resistances Ri and R2 
are selected to match the input and output signals. The Capacitor Ci eliminates 
some of the signal interference (voltage blanking for DC component). 

g. Phone-to-User Connection 

Direct audio connection (i.e., earpiece) is provided from a telephone to a 
user while at the same time causing no audible contact produced directly by a local 
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user to the local area. In an embodiment, telephone-to-user connector 30 includes 
an earpiece or other localized speaker system that is connected directly to the 
telephone or through some intermediate electronics (e.g., PC and soundcard). 
h. Upload/Download 
Data for conversational elements, their display conversation 
representations, and associated internal representation may be uploaded and 
downloaded between the Quiet Call system and other systems, including other 
Quiet Call systems, external memory devices (e.g.. Compact Disc ("CD"), Digital 
Video Disc ("DVD"), personal digital assistants), directly connected computers and 
networked computers (e.g., local area, wide area, Internet, wireless, etc.). 
Connection maybe made by serial connection (RS232, IrDA, ethemet, wireless, or 
other interconnections known in the art). Upon invocation of the upload command 
from a conversation representation 31 and/or utterance data storage 33, formatted 
data (e.g., raw byte data, rich text format, Hypertext Markup Language, etc.), are 
transmitted (e.g., TCP/IP, RS-232 serial data, etc.). Upon invocation of the 
download command, a conversation representation 3 1 formatted for stored data 
(conversational representation format, utterance data storage format), is sent to the 
appropriate Quiet Call components (conversational representation 31, utterance 
data storage 33). 

i. Stored Data Extractor 
Data for conversational elements, their display conversation 
representations, and associated internal representation may be extracted from 
stored information on a host computer. For example, calendar entries in a 
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Microsoft Outlook format may be dragged from an application to a store data 

extractor 32 form that parses and represents the calendar data. In this case, an 

Appointment object is accessed and its fields interrogated (e.g., Subject, Start, 

etc.). Text strings are extracted from the fields and a conversational phrase is 

formatted from these fields and phrase template. A template takes the form of 

some predefined text with slots for the appropriate data to be inserted: 

"An appointment for <subject> is scheduled to start at <start> '\ 
where the slots <subject> and <start> are supplied by text from 
the Appointment object 

Text-to-speech generation or special-purpose, predefined audio vocabularies may 

then be used to vocalize the appointment information. Other types of extracted 

data may include address book entries, database records, spreadsheet cells, email 

messages, driving directions, information pointers such as path names and 

universal resource locators and all manner of stored, task-specific information, 

B. Preparing for Quiet Call 

Fig. 4 illustrates the components in a Quiet Call system embodiment 
used for preparing conversation structure. In this mode the user or someone acting 
on behalf of the user prepares for a quiet-mode conversation by adding, deleting, or 
modifying conversation structures (representations, elements and internal 
representations) stored within a Quiet Call system. 

A user views a conversation representation 3 1 and makes selections about 
updating the utterances to be voiced over the telephone (e.g., add, modify, delete 
elements). The utterance data store 33 is updated appropriately. An 
upload/download produces the output signals to an audio output 41 to allow the 
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user to check the stored conversation. A store data extractor 32 converts data 
stored in other formats (e.g., PC calendar entries, address books) into a format 
suitable for inclusion into utterance data store 33. 

III. Quiet Call Method 

In an embodiment, a quiet-mode conversation is conducted according to 
the flowchart illustrated in Fig. 6. 

As one who is skilled in the art would appreciate, Fig. 6 illustrates logic 
boxes for performing specific functions. In alternate embodiments, more or fewer 
logic boxes may be used. In an embodiment of the present invention, a logic box 
may represent a software program, a software object, a software function, a 
software subroutine, a software method, a software instance, a code fragment, a 
hardware operation or user operation, singly or in combination. 

In an embodiment of the present invention, quiet call software illustrated 
by Figs. 6 and 15 is stored in an article of manufacture, such as a computer 
readable medium. For example, quiet call software may be stored in a magnetic 
hard disk, an optical disk, a floppy disk, CD-ROM (Compact Disk Read-Only 
Memory), RAM (Random Access Memory), ROM (Read-Only Memory), or other 
readable or writeable data storage technologies, singly or in combination. 

In an alternate embodiment. Quiet Call software is downloaded using 
Hypertext Transfer Protocol ("HTTP")1 to obtain Java applets. 

An incoming call is received by a user as represented by elliptic block 60. 
The user then accepts the call and accesses conversational representations as 
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illustrated by logic block 61 . A determination is then made by the user whether to 
continue the call as illustrated by decision block 62. If the user does not wish to 
continue a call, the telephone is hung up as illustrated by logic block 63, and the 
current call is complete as illustrated by elliptic block 65. If the user wishes to 
continue the call, the user listens and responds by selecting conversation elements 
from a conversational representation 31 as illustrated by logic block 64. Internal 
representations of all the conversational elements are obtained from an utterance 
data store 33 as illustrated by logic block 66. 

A decision is made by an individual whether additional utterances will be 
selected as illustrated by decision block 67. If no further utterances are needed, 
logic transitions to logic block 68 where the audio generation of each 
conversational element is transmitted to the telephone via the audio-to-phone 
connector 35. Logic then transitions back to decision block 67. 

The normal telephone call process proceeds as indicated in the flow chart. 
Exceptional situations in the Quiet Call method may occur asynchronously as 
follows: 1) Whenever the user wants live audio to be incorporated into the 
telephone call, the switchable audio input 36 is engaged; 2) The user is able to 
override the currently playing conversational element by making a new selection 
from a conversation representation 3 1 ; and 3) The user may hang up the telephone 
at any time to terminate the conversation. 

Fig. 1 5 illustrates a state transition diagram for a quiet call embodiment of 
the present invention. In particular, Fig. 15 illustrates a state transition diagram in 
which a mechanical device 157 having left button 157a, center button 157b and 
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right button 157c are used to transition into the various states. Buttons 157a-c are 
conversation representations for conversation elements. The buttons may represent 
different conversation representations at different states. In an embodiment of the 
present invention. Fig. 5 illustrates a state transition diagram of quiet call software. 

In the illustrated embodiment, five states are present: a wait-for-ring state 
151, a wait-to-answer state 152, a move-to-talk state 153, a Hsten-to-caller state 
1 54, a sign off state 155, and an any state 1 56. A user can transition to the various 
states by pressing buttons 157a-c. As the various states are transitioned, audible 
messages to a user maybe generated. 

For example, a transition from the wait-for-ring state 151 to the wait-to- 
answer state 1 52 is accomplished on the occurrence of an incoming call event. A 
user then has three options: the user may say nothing by pressing button 1 57a; the 
user may generate "Hello, please leave a message" utterance by pressing button 
157b; or, finally, the user may generate a "Hello, I'll be right with you" utterance 
which is heard only by the caller by selecting right button 1 57c. 

As can be seen by Fig. 15, embodiments of the present invention allow a 
user to conduct a conversation while causing no audible content to the local area. 

IV. Quiet Call Embodiments 

In a quiet mode conversation, all sides of the conversation use an electronic 
device, such as a mobile telephone. The device may be a wired or a wireless 
device. But the person in the 'unequal' public situation (i.e., having to be quiet) 
would have a special interface for responding to the conversation. Five different 
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embodiments are described below: (1) a PC, (2) a PDA, (3) a scanner and paper 
interface, (4) a telephone accessory device having a physical button interface, and 
(5) a telecommunications infrastructure having Quiet Call capability. Other 
embodiments may include using an intercom, CB radio, two-way radio, shortwave 
radio, or other radio transmitter such as FM or Bluetooth, etc. 
A. PC Embodiment 

A PC system embodiment for making Quiet Calls uses a personal computer 
as a private 'conversation appliance/ 

In a PC embodiment, a GUI template having a conversation representation 
is stored in the PC. A user, such as individual 17, points and clicks, and the 
computer 'talks' silently into the telephone through an audio connection. 

This is accomplished by storing the pre-recorded conversational phrases of 
interest in a format suitable for display and selection by the user. Figure 7 shows a 
GUI representation that contains conversational representations having internal 
representations expressed in the user's own voice. For example, a collection of 
Hello 70 icons are represented as icons 70a-d. A user may pre-record an intro 70a 
such as: "This is Les. I can hear you, but I am in a quiet area so I can only answer 
through my computer." Other types of icons and associated text may also be used. 
For example, control 71 icons may include icons 71a-f. Etiquette 71 icons may 
include icons 72a-b. For example, icon 72a may be an audible expressive "please" 
in the user's voice. Answer icon 73 includes icons 73a-d, and "Good-bye" icon 74 
includes icons 74a-c. 
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In an embodiment, Microsoft PowerPoint is used to form conversation 
representations and conversation elements: (1) a graphical structure, as illustrated 
by Fig. 7, whose nodes contain audio clips (WAV format); and (2) a text-to-speech 
generator (derived from an Active X component containing Microsoft Agent 
speech functionality). Microsoft Agent software includes text-to-speech 
functionality. Using standard Microsoft interface definitions (e.g. Active X 
component), Microsoft Agent text-to-speech functionahty is embedded into a 
PowerPoint slide and is used as a Quiet Call GUI providing text-to-speech 
functionality for Quiet calls. 

Conversational templates may be shared (e.g., as Web pages, shared files, 
e-mail messages) between a group of fi-equent user's (e.g., uploaded/downloaded). 
Individuals pick and choose the type of conversation in which they wish to engage 
and each works through a shared template using the Quiet Call interfaces. 

Fig. 2 illustrates a Quiet Call PC system embodiment System 20 includes 
a PC 21 having sound card which is connected to the input jack of a mobile 
telephone input. With the mobile telephone jack thus engaged, no audible content 
is produced directly by the local user to the local area. The user has an earpiece 
which allows the telephone conversation and the audio generated by the PC to be 
heard together. 

In an embodiment, personal computer 21 includes conversation 
representation 3 1 , utterance data store 33, audio generator 34, upload/download 40 
and audio output 41 as described above. In an embodiment of the present 
invention, conversation representation 3 1 is a power point slide show. Likewise, in 
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an embodiment of the present invention, utterance data store 33 is a power point 
representation. Similarly, audio generator 34 and upload/download 40 is a PC 
sound card and power point file transfer software, respectively. 

Audio output 36 is switchable between the PC speaker jack and the PC 
speaker. The PC speaker is disengaged while the speaker jack is in use. The PC 
speaker jack is coupled to an audio-to-phone connector 35. The generated 
conversation may be made audible in the user locale (e.g., as part of the preparation 
process) by removing the plug from the PC speaker jack. In an embodiment of the 
present invention, the audio-to-phone connector 22 is an impedance matching 
circuit as illustrated in Fig. 5. An impedance matching circuit permits the PC audio 
signals to be directed into the mobile telephone. In an embodiment, Ri=10K ohms, 
R2= 460 ohms, and Ci=0.1 microfarads. The audio-to-phone connector 35 is then 
coupled to a mobile telephone 23 audio input. 

In an embodiment of the present invention, the mobile telephone 23 is a 
QualComm pdQ Smartphone with hands-free headset in which we replace the 
microphone with a direct connection to the audio-to-phone connector 22. 
B. PDA Embodiment 

In a PDA embodiment, a GUI conversation representation is stored on 
PDA 80 and displayed on a PDA screen. The user taps the conversation buttons 
and the PDA 'talks' silently into the telephone through an audio connection. 

A PDA embodiment is illustrated in Fig. 8 and includes PDA 80 and PDA 
interface 81. PDA interface 81 is coupled to a controller 82. Audio output of 
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controller 82 is then coupled to audio-to-phone connector 83. Examples of specific 
structure of the various components of the PDA embodiment are described below. 

Figs. 8 and 9 illustrate a PDA embodiment (e.g., Qualcomm pdQ 
Smartphone having hands-free headset). PDA 80 uses a GUI as seen in Fig. 7 
whose nodes indicate audio clips. For example, indicators may be sequence 
numbers or addresses for digitally stored signal data (e.g. WAV-formatted data 
stored in a Quadravox 305 Playback Module). 

In an embodiment, a controller 82 (e.g., Quadravox QV305) stores audio 
clips that may be accessed randomly or sequentially. In an embodiment, controller 
82 is a Quadravox QV305 RS232 playback controller. In alternate embodiments, 
controller 82 communicates by a wired/wireless Universal Serial Bus ("USB"), 
IrDA connection, parallel port, ethemet, local area network, fiber wireless device 
connection (e.g. Bluetooth), in combination or singly. A PDA embodiment also 
includes upload/download 40 such as QVPro software supplied by Quadravox, Inc. 

Controller 82 is connected to a telephone input through an impedance matching 
circuit as illustrated in Fig. 5 that permits the PDA audio signals to be directed into 
the telephone. In an embodiment Ri=10K ohms, R2 ^ 460 ohms, and Ci = 0.1 
microfarads. PDA 80 is coupled to controller 82 through an RS232 serial port. 
The audio clip number indicated by selection on the PDA interface is 
communicated to controller 82 through the PDA serial port. The generated 
conversations are audible both in the hands-firee earpiece and through the telephone 
line, but no outside content is produced directly by the local user to the local area. 
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In an embodiment, conversation structure consisting of a spatially group 
collection of PDA software buttons 91 is shown in Fig. 9. A representative sample 
of conversation representation is shown, including: greetings (e.g., hello, goodbye); 
conversational flow control (e.g., wait, continue); and common answers to 
questions (e.g., yes, no). 

C. Paper User Interface Embodiment 

In a paper user interface embodiment, conversation representation is 
printed on paper (e.g., notebook or cards) as illustrated in Figs. 10, 1 1 and 12. A 
user scans (e.g., barcode or glyph reader) the conversation elements associated 
with the conversation representation (e.g. codes) and the computer 'talks' silently 
into the telephone through an audio connection. 

Fig. 1 1 illustrates a paper user interface Quiet Call embodiment. The paper 
user interface embodiment includes PDA 110 and controller 1 1 1 . In an 
embodiment, controller 1 1 1 is used as an utterance data store 33, audio generator 
34 and audio output 41. In an embodiment, controller 1 1 1 is a Quadravox QV305 
RS232 playback controller. A paper user interface embodiment also includes 
upload/download 40 such as QVPro software supplied by Quadravox, Inc. 
Controller 1 1 1 is coupled to audio-to-phone connector 112, In an embodiment, 
audio-to-phone connector 1 12 is an impedance matching circuit as illustrated by 
Fig. 5. Scanner 1 13 is also coupled to controller 111. Scanner 1 13 is used to read 
paper interface 1 14, including codes 115. 
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Fig. 12 also illustrates another embodiment of a paper interface. Paper 
interface 120 includes codes 121 (or conversation elements) for conversation 
representations such as "Hello." 

In Fig. 11, a scanner 113 such (such as a Symbol SPT-1500 barcode 
scanner) is used to read conversational elements. In an embodiment, a scanner 1 13 
is coupled to controller 1 1 1 through an RS232 port. Each code indicates an audio 
clip (WAV format) associated with the conversation representation. 

A controller 111 (e.g., Quadravox QV305 RS232 Playback Controller) 
stores audio clips that may be accessed randomly or sequentially. Controller 1 1 1 is 
connected to a telephone input through an impedance matching circuit 1 1 2 which 
permits the audio signals to be directed into the telephone. In an embodiment, 
Ri=10K ohms, R2=460 ohms, and Ci =0.1 microfarads. The audio clip number 
indicated by selection on the PDA interface is communicated to controller 1 1 1 
through a PDA RS232 serial port. The generated conversations are audible both in 
the hands-free earpiece and through the telephone line, but not in the general locale 
of the user. 

D. Telephone Accessory Embodiment 

In a telephone accessory embodiment, physical interfaces such as labeled 
buttons are conversation representations. A device is attached to a telephone as a 
telephone accessory or may be incorporated into the design of a telephone 
mechanism itself. A user pushes a conversation button and the computer 'talks' 
silently into the telephone through an audio connection. 
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Fig. 13 illustrates a telephone accessory embodiment of the present 
invention. The telephone accessory embodiment includes mobile telephone 130 
coupled to device 131 which is coupled to audio-to-phone connector 132. Device 
131 is a physical interface having labeled or marked buttons as respective 
conversation representations. 

In a telephone accessory embodiment, the mobile telephone 130 is a 
Qualcomm PDQ Smartphone having a hands-free headset. In a telephone 
accessory embodiment, device 1 3 1 is an electronic record and playback device. In 
an embodiment, audio-to-phone connector 1 32 is an impedance matching circuit as 
illustrated by Fig. 5. 

In an embodiment, one or more single-channel audio record and playback 
chips (e.g., Radio shack"^"^ Recording Keychain) stores the audio that may be 
accessed through the labeled control buttons. The chips are connected to the 
telephone input through audio-to-phone connector 132 which permits the audio 
signals to be directed into the telephone. In an embodiment, audio-to-phone 
connector 132 is an impedance matching circuit as illustrated in Fig. 5 having 
Ri-IOK ohms, R2= 460 ohms, and Ci=0.1 microfarads. The generated 
conversations are audible both in the hands-free earpiece and through the telephone 
line, but not in the general locale of the user. 

A one-chip version can hold a single greeting or multiple greetings that 
may be used to defer the conversation until the user moves to an area where 
full-voice conversation may resume. Other chips may be added for alternative 
greetings (e.g., mobile call screening) or limited responses (e.g., yes, no, etc.). 
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In an alternate embodiment, a talking object is provided. For example, a 
credit card having Quiet Call technology (e.g. by using the described chip 
arrangement) generates an audible utterance (e.g. an account number) quietly. 
Hence, private information will not be overheard when being used to confirm 
reservations or other purposes. 

E. Telecommunications Infrastructure Embodiment 
As described above, a voice call is conducted where at least one of the 
telephones has a non-verbal interface (e.g., buttons or touchscreen). The non- 
verbal interface is used to select and play voice utterances (recorded or synthetic) 
over the telephone connection. There are a number of places where audio 
production maybe introduced in the call's voice path as illustrated by Figure 14. In 
an embodiment, receiving caller 142 is a mobile telephone user who needs to take 
important calls, but is not always in a situation where conversation is appropriate 
(e.g., meetings, public transportation, waiting areas). 

Fig. 14 illustrates a telecommunications infrastructure 140 having Quiet 
Call technology. Telecommunications infrastructure 140 includes a telephone 143 
used by initiating caller 141. Telephone 143 accesses telecom service provider 146. 
Telephone 143 optionally accesses telephony server 145 that is coupled to telecom 
service provider 146. In an embodiment, telecom service provider 146 accesses 
telecom service provider 147, which controls telephony server 148. Telephony 
server 148 then provides services to mobile telephone 144. Software and/or 
mechanical devices anywhere along the telecommunications infrastructure 140 
may be used to implement embodiments of the Quiet Call technology. For 
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example, Quiet Call software may be implemented at telecom service provider 147. 
The user then may initiate utterances by selecting buttons on mobile telephone 
144. 

In alternate embodiments, Quiet Call software and/or structures as 
described above may be positioned at other sections along the telecommunications 
infrastructure 140, such as in telephone 144 and/or 143. 

i. In-band and Out-of-Band Utterance Selection 
There are at least two Quiet Call telecommunication infrastructure 
embodiments: 1) control signals for utterance selections made by a caller are 
mixed with the voice audio (i.e., in-band communication such as touch tones) or 2) 
control signals use a communication channel different from the voice signal (i.e., 
out-of-band). In both embodiments a server application capable of generating 
Quiet Call utterances has access to a telecommunications infrastructure and can 
manipulate the contest of the voice path of a call (e.g., a telephone server of a 
service provider) as illustrated in Fig. 14. 

a. In-band Selection for Adding Voice Audio 
Figs. 1 6a~b illustrate in-band telecommunication infrastructure 
embodiments and a Quiet Call server. 

If a telephone supports a text display, a set of possible utterances is 
displayed on a telephone. The text is either configured with the telephone, 
obtained previously from a telecommunication provider (e.g., downloaded in a 
previous voice or data call), obtained or customized during a current call. 
Communication could be through telephone information fields such as caller ID or 
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through in-band signaling such as Dual-Tone Multi Frequency ("DTMF"), for 
touch tone signaling, fax tones, or a custom signaling technique that is in some way 
more audibly appealing (e.g., rhythmic or musical sequences). 

If a telephone supports dedicated selection keys, these may be used to 
navigate the conversation element selections. When one of the options is selected, 
a message with the encoded selection is sent back to the provider with in-band 
signaling. The selection message is used to access the corresponding conversation 
element. 

If the telephone does not support selection keys, the standard numeric pad 
may be used for the selection (e.g., *, 1 ,2, etc.). The associated DTMF signal might 
be suppressed from the other party by carrier or provider specific mechanisms or 
by briefly putting the initiating caller on hold while the DTMF is being processed. 
Alternatively, the telephone could support alternative tone generation that is not so 
audibly disturbing (e.g., other frequency or rhythmic patterns.) 

In an embodiment, a receiving caller's telephone 162 would have the quiet 
call technology to access a Quiet Call server 160 and Quiet Call Systems 160a as 
illustrated in Fig. 16b. 

In an alternative embodiment, an initiating caller's telephone 160 would 
have the quiet call technology to access a Quiet Call server 160 and Quiet Call 
Systems 160a as illustrated in Fig. 16b. 

In an alternative embodiment, a third party provider is brought into the call 
(most likely by the receiving caller) as illustrated in Fig. 16a. In this case, a 
conference call would be established to accept a receiving caller conversation 
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element selection signals (most likely as DTMF or other audible pattern) and 
translate them into corresponding audible utterances. 

The following describes various in-band telecommunication infrastructure 
embodiments. First, a proxy answer at a Quiet Call server embodiment may be 
used. A call to a mobile telephone is actually first placed through a service 
number. This may be made transparent to initiating caller 161 by providing the 
service number as the point of contact. A Quiet Call server 160 (e.g., telephony 
program or service provider function) answers the incoming call and dials a 
receiving caller's mobile telephone 162. Receiving caller 162 answers mobile 
telephone 162 and completes a connection to the initiating caller 161. The 
receiving telephone 1 62, then quickly makes a connection to Quiet Call server 1 60 
(e.g., through a conference call or as a relay with the server application acting as an 
intermediary, as shown in Figs. 16a-b).Receiving caller 162 makes Quiet Call input 
selections that are signaled to Quiet Call server 1 60 for decoding and translation to 
the appropriate audible utterance. The in-band signaling may itself be audible to 
initiating caller 161 (e.g., as in a continuous three-way conference call connection 
shown in Fig. 161) or may be screened from initiating caller 161 (e.g., as in a relay 
connection or shown in Fig. 16b or by quickly putting the initiating caller 161 
momentarily on hold during control signal progressing. 

Second, a third party add-in from mobile handset may be used in an 
embodiment. A call is first placed directly to receiving caller's mobile telephone 
1 62. Receiving caller answers mobile telephone 1 62 and a connection is made with 
initiating caller 161. The telephone quickly makes a connection with a quiet call 
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server 1 60 (e.g., by dialing in a conference call or relay connection or by accessing 
a persistent conference call or relay connection). In-band signaling and utterance 
generation then proceeds in a manner similar to that described above. 

In-band signaling has the advantage that only one communication channel 
is required for both voice and data communication and it can work without 
modification of the telecommunications infrastructure (e.g., DTMF support is 
already in the system). Under certain circumstances, an audible signahng might be 
helpful in giving some initiating callers audible cues about the receiving callers 
situation. The disadvantages are in requiring most initiating callers to either put up 
with the audible control signals they do not want to hear (e.g., by ignoring or 
disguising them) or hide them from the initiating caller (e.g., putting the initiating 
caller on hold during control signal processing). In-band signaling is also limited 
to how much and how quickly control data can be communicated through the 
audible channel. 

b. Out-of-band Selection for Adding Voice Audio 
A selected conversation element may be communicated to a Quiet Call 
server through some means other than a voice channel of the telephone call. Fig. 
17 illustrates an out-of-band telecommunication infrastructure embodiment 170. 
As with in-band signaling, a call may be placed through a service number (proxy 
answer approach described above) or directly to the receiving caller's mobile 
telephone (third-party add-in). A Quiet Call server is either connected to the voice 
call through a conference call or relay configuration. 
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The following describes out-of-band control embodiments. 

First, a related voice and data connections embodiment may be used. 
Telecommunication systems (such as Integrated Services Digital Network, 
("ISDN") carry voice and data on separate channels. For example, instead of the 
telecommunication provider sending a ring voltage signal to ring a bell in your 
telephone (in-band signal), the provider sends a digital packet on a separate 
channel (out-of-band signal). A call is processed by a telecommunications service 
provider by establishing a voice channel and a related control data stream. Control 
information is sent to a Quiet Call server independently from a voice 
communication using a alternate data channel. A Quiet Call server, being in 
connection with the voice path, introduces the appropriate utterances as described 
above. 

Second, a digital communication, such as Code Division Multiple Access 
("CMDA") and Voice-over-IP ("VoIP"), encode voice and data as bits and allow 
for simultaneous communication by interleaving the packets on the digital channel 

Third, a separate data connection embodiment may be used. In an 
embodiment, a handset is set up with a separate data connection or a second device 
(e.g., wirelessly connected PDA) to communicate control information between a 
receiving caller and Quiet Call server. 

Fourth, an additional telephone connection embodiment maybe used. 
A handset is set up with a multiple telephone capability or several telephones could 
be used. One call would communicate control information between a receiving 
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caller and Quiet Call server 171. The other telephone 1 73 would have a connection 
between all parties (initiating caller, receiving caller, and server application). 

Fifth, when using a channel supporting simultaneous mixed digital voice 
and data (e.g., VoIP combined with an IP-enabled phone acting as the Quiet Call 
Phone), synthetic or pre-recorded conversation elements may be stored as simple 
data packets on a telephone handset. For a receiving caller to obtain an audio 
utterance, prerecorded data sets are injected into a initiating caller's digital data 
stream, 

Out-of-band signaling has the advantage that the control signals do not 
have to be hidden (e.g., through temporarily holding the initiating caller), disguised 
(e.g., as rhythmic patterns), or endured (e.g., touch tones). The disadvantage is that 
several communication channels require management, except in the case of 
intermixed voice and data packet communication (e.g., VoIP). 

ii. VoIP Telecommunication Infrastructure 

VoIP is the ability to make telephone calls and send faxes over IP -based 
data networks with a suitable quality of service (QoS) and superior costA)enefit. 
see http://ww-w\protocols.com/'papers/voiT3.htm and http://www.techquide.com. 
Voice data is encoded into data packets and sent using Internet Protocol. 

Net2phone*s (http://www.net2phone.com) Parity software 
(http://www.paritysw.com/products/spt__ip.htm) "PC with Voice Software" 
provides a VoIP telephony development Application Program Interface ("API") 
according to an embodiment of the invention. 
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In a VoIP embodiment, information is transferred by way of the internet, 
telephone switches and/or local networks. Figures 18a-18e illustrate various 
telecommunication infrastructure embodiments using VoIP functionaUty. The 
infrastructure embodiments differ in where the Quiet Call voice utterances are 
stored/generated and in whether the phones used in Quiet Calls dialogue are 
IP-enabled. Table A shows 5 different configurations related to the various 
infrastructures embodiments illustrated in Figs. 18a-18e. 



Quiet Phone 

IP-enabled 

(yes/no) 


Other Phone 
IP-enabled 

(yes/no) 


Voice Utterances 
stored/generated on 
the Quiet Phone 
(yes/no) 


Figure illustrating the 

telecommunication 

infrastructure 


No 


No 


No 


Fig. 18a 


Yes 


No 


No 


Fig. 18b 


Yes 


Yes 


No 


Fig. 18c 


Yes 


Yes 


Yes 


Fig. 18d 


Yes 


No 


Yes 


Fig. 18e 



Table A 



In Fig. 18a a non-IP-enabled telephone 180 capable of issuing DTMF 
signals acts as a Quiet Phone and controls the playback/generation of voice 
utterances from a Quiet Phone server 181 via a VoIP gateway 182. The DTMF 
control signals are detected by VoIP gateway 182 and routed to the Quiet phone 
server 181 as IP data packets with the appropriate Quiet Call control codes. The 
Quiet Phone server 181 receives the IP data packets with the Quiet Call control 
codes and responds by sending the stored/generated Quiet Call voice utterances as 
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IP data packets to (a) VoIP gateway 1 83 communicating with the Other phone 1 84 
and (b) VoIP gateway 182 communicating with Quiet phone 180. Voice from 
Other phone 1 84 goes to VoIP gateway 1 83 and is routed to the Quiet phone as IP 
data packets to the VoIP gateway 182 communicating with Quiet phone 180. 

In Fig. 18a, any telephone capable of generating DTMF signals can be 
turned into a Quiet Phone by simply subscribing to the Quiet Phone service 
residing on Quiet Phone server 181 . 

In Fig. 18b, an IP-enabled telephone 190 acts as the Quiet Phone and 
controls the playback/generation of voice utterances from the Quiet Phone server 
191 by sending Quiet Call control codes as IP data packets to the Quiet Phone 
server 191. The Quiet Phone server 1 9 1 receives the IP data packets with the Quiet 
Call control codes and responds by sending the stored/generated Quiet Call voice 
utterances as IP data packets to (a) VoIP gateway 193 communicating with the 
Other phone 194 and (b) the IP-enabled Quiet phone 190. Voice from the Other 
phone 194 goes to the VoIP gateway 193 and is routed to the Quiet phone 190 as 
IP data packets. 

In Fig. 1 8c, an IP-enabled telephone acts as a Quiet phone 200 and controls 
the playback/generation of voice utterances from a Quiet Phone server 201 by 
sending Quiet Call control codes as IP data packets to the Quiet Phone server 201 . 
The Quiet Phone server 201 receives the IP data packets with the Quiet Call 
control codes and responds by sending the stored/generated Quiet Call voice 
utterances as IP data packets to (a) the IP-enabled Other phone 204and (b) the 
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IP-enabled Quiet phone 200. Voice from the Other phone 204 is routed to the 
Quiet phone 200 as IP data packets. 

In Fig. 1 8d, an IP-enabled telephone acts as the Quiet phone 21 0 and sends 
stored/generated Quiet Call voice utterances as IP data packets to the IP-enabled 
Other phone 214. Voice from the Other phone 214 is routed to the Quiet phone 
210 as IP data packets. 

In Fig. 1 8e, an IP-enabled telephone acts as the Quiet phone 220 and sends 
stored/generated Quiet Call voice utterances as IP data packets to VoIP gateway 
221 communicating with the Other phone 224. Voice from the Other phone 224 
goes to the VoIP gateway 221 and is routed to the Quiet phone 220 as IP data 
packets. 

iii. Wireless Telephony Applications and Interfaces 
In an embodiment, Wireless Telephony Applications Framework (" WTA") 
within a Wireless Application Protocol ("WAP") is used for a Quiet Call 
embodiment. For example, Quiet Call software is stored on a WTA server 
accessed from a microbrowser stored on a mobile telephone. 

The foregoing description of the preferred embodiments of the present 
invention has been provided for the purposes of illustration and description. It is 
not intended to be exhaustive or to limit the invention to the precise forms 
disclosed. Obviously, many modifications and variations will be apparent to 
practitioners skilled in the art. The embodiments were chosen and described in 
order to best explain the principles of the invention and its practical appUcations, 
thereby enabling others skilled in the art to understand the invention for various 
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embodiments and with the various modifications as are suited to the particular use 
contemplated. It is intended that the scope of the invention be defined by the 
following claims and their equivalents. 
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What is claimed is: 

1 . A personal computer, comprising: 

(a) an input for receiving audio; 

(b) a display for providing a conversation representation; 

(c) a memory for storing the conversation representation and an 
associated conversation element, wherein the conversation element has an 
internal representation of an audible utterance; 

(d) a processor, coupled to the audio input, display and memory, for 
providing a control signal; and, 

(e) an audio output, coupled to the processor and memory, for providing 
the audible utterance responsive to the control signal and the conversation 
element. 

2. The personal computer of claim 1 , wherein an impedance matching circuit 
is coupled to the audio output. 

3. The personal computer of claim 2, wherein a telephone is coupled to the 
impedance matching circuit. 

4. The personal computer of claim 1, wherein the personal computer further 
comprises: 

(f) an audio generator, coupled to the processor and audio output, for 
generating the audible utterance. 
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5 . The personal computer of claim 1 , wherein the conversation representation 
is in a graphic user interface (GUI). 

6. The personal computer of claim 1 , wherein the conversation representation 
is selected from the group consisting of an icon, a symbol, a figure, a graph, a 
checkbox, a GUI widget and a graphic button. 

7. The personal computer of claim 1 , wherein the conversation representation 
is selected from the group consisting of a text and a label. 

8. The personal computer of claim 1, wherein the conversation element is 
selected from the group consisting of a phrase, a word, a letter, a number, a symbol, 
and a sound effect. 

9 . The personal computer of claim 1 , wherein the internal representation is in a 
format selected from the group consisting of a sound file, a record or playback, a 
text and a Musical Instrument Digital Interface ("MIDI") sequence. 

10. The personal computer of claim 1, wherein a user alters the conversation 
representation. 
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1 1 . The personal computer of claim 1, wherein a user alters the conversation 
element. 

1 2. The personal computer of claim 1 , wherein a user deletes the conversation 
representation. 

1 3 . The personal computer of claim 1 , wherein a user deletes the conversation 
element. 

14. The personal computer of claim 1, wherein a user adds the conversation 
element. 

15. The personal computer of claim 1, wherein a user adds the conversation 
representation. 

16. The personal computer of claim 1, wherein a user alters the association 
between the conversation representation and the conversation element. 

17. The personal computer of claim 1 , wherein a user records the conversation 
element. 

1 8. The personal computer of claim 1 , wherein the conversation representation 
and the conversation element are loaded from a host computer. 
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1 9 . The personal computer of claim 1 , wherein the control signal is generated in 
response to a user selecting the conversation representation. 

20. The personal computer of claim 1, wherein an earpiece is coupled to the 
audio output for listening by a user. 

21. A personal computer, comprising: 

(a) an input for receiving audio; 

(b) a device for providing a conversation representation; 

(c) a memory for storing a conversation element associated with the 
conversation representation, wherein the conversation element has an 
internal representation of an audible utterance; 

(d) a processor, coupled to the audio input, device and memory, for 
generating a control signal responsive to a device signal; and, 

(e) an audio output, coupled to the processor and memory, for providing 
the audible utterance responsive to the control signal and the conversation 
element. 

22 . The personal computer of claim 2 1 , wherein an impedance matching circuit 
is coupled to the audio output. 

23. The personal computer of claim 22, wherein a telephone is coupled to the 
impedance matching circuit. 
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24. The personal computer of claim 2 1 , wherein the personal computer further 
comprises: 

(f) an audio generator, coupled to the processor and audio output, for 
generating the audible utterance. 

2 5 . The personal computer of claim 2 1 , wherein the conversation representation 
is selected from the group consisting of a button, a switch, a barcode, a label, a 
glyph, and Braille. 

26. The personal computer of claim 21 , when the control signal is generated in 
response to a user selecting the conversation representation. 

27. The personal computer of claim 21, where an earpiece is coupled to the 
audio output for listening by a user. 

28. The personal computer of claim 21, wherein the conversation element is 
selected from the group consisting of a phrase, a word, a letter, a number, a symbol, 
and a sound effect, 

29 . The personal computer of claim 2 1 , wherein the internal representation is in 
a format selected from the group consisting of a sound file, a record or a playback, 
text and a Musical Instrument Digital Interface (" MIDI") sequence. 
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SO. A personal computer system, comprising: 

(a) an audio input for receiving audio; 

(b) a display for providing the conversation representation icon; 

(c) a memory for storing the conversation representation icon and an 
associated conversation element, wherein the conversation element has an internal 
representation of an audible utterance; 

(d) a processor, coupled to the audio input, display and memory, for 
generating a control signal; 

(e) an audio generator, coupled to the processor, for generating the 
audible utterance responsive to the control signal and the conversation element; 

(f) an audio output, coupled to the audio generator, for providing the 
audible utterance; 

(g) an impedance matching circuit coupled to the audio output; and, 

(h) a telephone coupled to the impedance matching circuit. 

31. A system, comprising: 

(a) a processing device for storing an internal representation of a 
conversation element; and, 

(b) a scanning device, coupled with a processing device, for reading a 
code associated with the conversation element, wherein the processing 
device provides an audible utterance in response to reading the code and 
the conversation element. 
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32. The system of claim 3 1 , wherein the processing device comprises: 

(a) a personal digital assistant; 

(b) a controller coupled to the personal digital assistant; and, 

(c) an impedance matching circuit coupled to the controller. 

33. The system of claim 3 1 , wherein the code is a barcode on a printed card. 

34. The system of claim 3 1 , wherein the scanning device is a barcode scanner. 

35. The system of claim 31, wherein the scanning device is a laser scanner. 

36. The system of claim 3 1 , wherein the scanning device is a digital camera. 

37. The system of claim 32, wherein the system includes a touchscreen and 
wherein the conversation representation associated with the conversation element is 
in a Graphic User Interface ("GUI") on the touchscreen. 

38. The system of claim 37, wherein the conversation representation is selected 
from the group consisting of an icon, a symbol, a figure, a graph, a checkbox, a 
GUI widget and a graphics button. 
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3 9 . The system of claim 3 7 wherein the conversation representation is selected 
from the group consisting of a text and a label. 

40 . The system of claim 3 1 , wherein the conversation element is selected from 
the group consisting of a phrase, a word, a letter, a number, a symbol, and a sound 
effect. 

4 1 . The system of claim 3 1 , wherein the internal conversation representation is 
in a format selected from the group consisting of a sound file, a record or playback, 
a text and a Musical Instrument Digital Interface (" MIDI") sequence. 

42. The system of claim 31, wherein a user alters the conversation 
representation. 

43 . The system of claim 3 1 , wherein a user alters the conversation element. 

44. The system of claim 31, wherein a user deletes the conversation 
representation. 

45. The system of claim 3 1 , wherein a user deletes the conversation element. 

46. The system of claim 3 1 , wherein a user adds a conversation element. 
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The system of claim 3 1 , wherein a user adds a conversation representation. 



48. The system of claim 3 1 , wherein a user alters the association between the 
conversation representation and the conversation element. 

49. The system of claim 3 1 , wherein a user records a conversation element. 

50. The of claim 1, wherein the conversation representation and the 
conversation element is loaded from a host computer. 
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ABSTRACT 

A user conducts a telephone conversation without speaking. It does this by 
moving the participant in the pubHc situation to a quiet mode of communication 
(e.g., keyboard, buttons, touchscreen). All the other participants are allowed to 
continue using their usual audible technology (e.g., telephones) over the existing 
telecommunications infrastructure. The quiet user interface transforms the user's 
silent input selections into equivalent audible signals that may be directly 
transmitted to the other parties in the conversation. 
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